53 8, ^ 



(12) INTERNATIONAL APP 



ON PUBLISHED UNDER THE PATENT COOP 



(19) World Intellectual Property 
Organization 
International Bureau 

(43) International Publication Date 
5 August 2004 (05.08.2004) 




ON TREATY (PCT) 



(10) International Publication Number 

PCT WO 2004/066552 Al 



CG 


Not furnished (POA) 


Filed on 


Not furnished 


CI 


Not furnished (POA) 


Filed on 


Not furnished 


CM 


Not furnished (POA) 


Filed on 


Not furnished 


GA 


Not furnished (POA) 


Filed on 


Not furnished 


GN 


Not furnished (POA) 


Filed on 


Not furnished 


GQ 


Not furnished (POA) 


Filed on 


Not furnished 


GW 


Not furnished (POA) 


Filed on 


Not furnished 


ML 


Not furnished (POA) 


Filed on 


Not furnished 


MR 


Not furnished (POA) 


Filed on 


Not furnished 


NE 


Not furnished (POA) 


Filed on 


Not furnished 




[Continued on next page] 



(51) International Patent Classification 7 : H04L 9736, 1/00, 
G06F 12/14, 11/10, H04N 1/41, 7/167 

(21) International Application Number: 

PCT/JP2004/000619 

(22) International Filing Date: 23 January 2004 (23.01.2004) 

(25) Filing Language: English 

(26) Publication Language: English 



(30) Priority Data: 

2003-015233 



23 January 2003 (23.01 .2003) JP 



(61) Related by addition to earlier applications or grants: 

BF Not furnished (POA) 
Filed on Not furnished 

BJ Not furnished (POA) 
Filed on Not furnished 

CF Not furnished (POA) 
Filed on Not furnished 



(54) Title: INFORMATION PROCESSING METHOD, APPARATUS, AND INFORMATION PROCESSING PROGRAM 



ENCRYPTION 
PROCESSOR 



IT) 

in 

V© 



o 



^S121 

ERROR-DETECTING 
ENCODED ? (FIRST ERROR-DETECTING 
ENCODING INFORMATION ) 



YES 



CHANGE FIRST ERROR-DETECTING 
ENCODING INFORMATION 



CHANGE SECOND ERROR-DETECTING 
ENCODING INFORMATION 



S122 



S123 



ENCRYPTION 



c 



S124 



ENCRYPTION 
PROCESSOR 



3 



(57) Abstract: Even when encoded 
(compressed) image data appended with 
an error-detecting code is encrypted, the 
apparatus which receives and reproduces 
that image data can execute a normal process 
without any insignificant re-send request and 
the like. To this end, encoded image data 
is input, and first error-detecting encoding 
information contained in its header is checked 
to determine whether or not an error-detecting 
code is appended. If it is determined that 
the error-detecting code is appended, the 
first error-detecting encoding information 
is changed to indicate the absence of an 
error-detecting code, and is saved as second 
error-detecting encoding information. Then, 
the encoded image data is encrypted. 



wo2#/066552 Ai iBin iiiiiBi ii null mil urn mil mi Mjpl urn i»n inn HHi nit ii»m mi mi mi 



SN Not furnished (POA) 

Filed on Not furnished 

TD Not furnished (POA) 

Filed on Not furnished 

TG Not furnished (POA) 

Filed on Not furnished 



(71) Applicant (for all designated States except US): CANON 
KABUSHIKI KALSHA [JP/JP]; 3-30-2, Shimomaruko, 
Ohta-ku, Tokyo 1468501 (JP). 

(72) Inventors; and 

(75) Inventors/Applicants (for US only): HAYASHI, Junichi 
[JP/JP]; c/o CANON KABUSHIKI KAISHA, 3-30-2, Shi- 
momaruko, Ohta-ku, Tokyo 1468501 (JP). SUGA, Yuji 
[JP/JP]; c/o CANON KABUSHIKI KAISHA, 3-30-2, Shi- 
momaruko, Ohta-ku, Tokyo 1468501 (JP). 

(74) Agent: OHTSUKA, Yasunori; 7th FL., SHUWA KIOI- 
CHO PARK BLDG., 3-6, KIOICHO, CHIYODA-KU, 
Tokyo 1020094 (JP). 

(81) Designated States (unless otherwise indicated, for every 
kind of national protection available): AE, AG, AL, AM, 



AT, AU, AZ, BA, BB, BG, BR, BW, BY, BZ, CA, CH, CN, 
CO, CR, CU, CZ, DE, DK, DM, DZ, EC, EE, EG, ES, FI, 
GB, GD, GE, GH, GM, HR, HU, ID, IL, IN, IS, KE, KG, 
KP, KR, KZ, LC, LK, LR, LS, LT, LU, LV, MA, MD, MG, 
MK, MN, MW, MX, MZ, NA, NI, NO, NZ, OM, PG, PH, 
PL, PT, RO, RU, SC, SD, SE, SG, SK, SL, S Y, TJ, TM, TN, 
TR, TT, TZ, UA, UG, US, UZ, VC, VN, YU, ZA, ZM, ZW. 

(84) Designated States (unless otherwise indicated, for every 
kind of regional protection available): ARIPO (BW, GH, 
GM, KE, LS, MW, MZ, SD, SL, SZ, TZ, UG, ZM, ZW), 
Eurasian (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), Euro- 
pean (AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, FI, FR, 
GB, GR, HU, IE, IT, LU, MC, NL, PT, RO, SE, SI, SK, 
TR), OAPI patent (BF, BJ, CF, CG, CI, CM, GA, GN, GQ, 
GW, ML, MR, NE, SN, TD, TG). 

Published: 

— with international search report 

For two-letter codes and other abbreviations, refer to the "Guid- 
ance Notes on Codes and Abbreviations" appearing at the begin- 
ning of each regular issue of the PCT Gazette. 



WO 2004/066552 



- i - 



PCT/JP2004/000619 



DESCRIPTION 

INFORMATION PROCESSING METHOD, APPARATUS, AND 
INFORMATION PROCESSING PROGRAM 



5 TECHNICAL FIELD 

The present invention relates to a technique and 
the like for encrypting encoded (compressed) digital 
image data. 



10 BACKGROUND ART 

Conventionally, in order to transmit image data 
or the like in secret, the entire image data undergoes 
encryption, scrambling, or the like. Such techniques 
are used to encrypt all or some components of image 
15 data in advance using an encryption key, and allow only 
a person or device which has a decryption key 
corresponding to the encryption key to normally decrypt 
the encrypted image data. 

On the other hand, since image data has a large 
20 information size, encoding (compression) is normally 

done to efficiently transmit and store such image data. 
As encoding (compression) techniques, a technique 
called JPEG2000 standardized by, e.g., ISO IEC JTC 1/SC 
29/WG1 and the like are promising. Therefore, it is 
25 desired to apply the aforementioned encryption process 
of image data to image data encoded (compressed) by, 
e.g., JPEG2000. 
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In JPEG2000, even when any error has occurred 
during a transmission process, a function of detecting 
such error can be used. Since the transmitting side 
encodes (compresses) image data using this function 
5 upon transmission, even when the receiving side detects 
any error during decoding (decompression), it can 
normally decode (decompress) the image data by sending 
a re -send request that requests the transmitting side 
to re-transmit only data of such errored part and 

10 decoding (decompressing) the re- transmitted data. 

However, as described above, when image data is 
encoded (compressed) to allow error-detecting, and the 
encoded (compressed) image data further undergoes the 
encryption process, the error- detecting function often 

15 does not work normally. This is because the receiving 
side determines the encrypted image data as image data 
that has caused an error (as a wrong determination 
result). In such case, even when the re-send request 
of a part, which is determined to have an error, is 

20 transmitted to the transmitting side, the transmitting 
side which knows that the part is normal transmits the 
same image data (as the part determined to have an 
error) , as a matter of course* In some cases, the 
re- send request may be repeated. 



DISCLOSURE OF INVENTION 
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The present Invention has been made in 
consideration of the above problems, and has as its 
object to provide a technique that allows, even when 
encoded image data appended with an error-detecting 
5 code is encrypted, an apparatus which receives and 
reproduces such data to execute a normal process 
without any insignificant re-send request or the like. 
In order to achieve this object, for example, an 
information processing method of the present invention 

10 comprises the following steps. 

Other features and advantages of the present 
invention will be apparent from the following 
description taken in conjunction with the accompanying 
drawings, in which like reference characters designate 

15 the same or similar parts throughout the figures 
thereof . 

BRIEF DESCRIPTION OF DRAWINGS 
Fig. 1 is a block diagram showing the arrangement 
20 of an encoding (compression) processor in an embodiment 
of the present invention; 

Figs. 2A to 2C are views for explaining a 
discrete wavelet transformer in the embodiment; 

Fig. 3 is a view for explaining entropy encoding 
25 in the embodiment; 

Figs. 4A to 4D are views for explaining a code 
stream in the embodiment; 
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Fig, 5 is a block diagram showing the arrangement 
of a decoding (decompression) processor in the 
embodiment ; 

Fig. 6 is a view for explaining entropy decoding 
5 (decompression) in the embodiment; 

Figs. 7A and 7B are block diagrams for explaining 
an inverse discrete wavelet transformer in the 
embodiment ; 

Figs. 8A and 8B are views for explaining 
10 hierarchical decoding (decompression) in the 
embodiment ; 

Fig. 9 is a block diagram showing the arrangement 
of the overall system in the embodiment; 

Fig. 10 shows a structure of data appended with 
15 an error-detecting code in the embodiment; 

Fig. 11 is a block diagram showing the 
arrangement of an encryption processor in the first 
embodiment ; 

Fig. 12 is a flow chart showing an encryption 
20 process sequence in the first embodiment; 

Fig. 13 is a block diagram showing the 
arrangement of a decryption processor in the first 
embodiment ; 

Fig. 14 is a flow chart showing a decryption 
25 process sequence in the first embodiment; 

Fig. 15 is a flow chart showing another 
decryption process sequence in the first embodiment; 
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Fig. 16 is a block diagram showing the 
arrangement of an encryption processor in the second 
embodiment ; 

Fig. 17 is a flow chart showing an encryption 
5 process sequence in the second embodiment; 

Fig. 18 is a block diagram showing the 
arrangement of a decryption processor in the second 
embodiment ; 

Fig. 19 is a flow chart showing a decryption 
10 process sequence in the second embodiment; 

Fig. 20 is a block diagram showing the 
arrangement of an encryption processor in the third 
embodiment ; and 

Fig. 21 is a flow chart showing the sequence of 
15 an encryption process and error -detecting encoding 
process in the third embodiment. 

BEST MODE FOR CARRYING OUT THE INVENTION 
Preferred embodiments of the present invention 
20 will be described hereinafter with reference to the 
accompanying drawings, 
description of Overall Arrangement > 

Fig. 9 shows an example of a system overview in 
this embodiment. Referring to Fig. 9, reference 
25 numeral 90 denotes the Internet; and 91 , an apparatus 
for executing an encoding (compression) & encryption 
process of image data sensed by a digital camera, image 
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scanner, film scanner , or the like. Reference numeral 
92 denotes an apparatus which receives image data and 
decodes (decompresses) and decrypts the received image 
data; and 93, an authentication server which stores a 
5 decryption key required upon decrypting the image data* 
The apparatuses 91 to 93 can be versatile apparatuses 
such as personal computers and the like- The flow of 
the process will be briefly described below. 
The apparatus 91 executes an encoding 
10 (compression) & encryption process of desired image 

data, and distributes the processed image data via the 
Internet 90. The apparatus 91 may distribute the image 
data directly or via an appropriate server. In this 
case, since the image data is encrypted, key 
15 information required to decrypt that encrypted image 

data is registered in a DB of the authentication server 
93 together with information (e.g., an ID) used to 
specify that image data. The image decode 
(decompress) /decrypt apparatus 92 is used to receive a 
20 desired image, decode (decompress) /decrypt that image, 
and browse the decrypted image. In order to browse 
encrypted image data, the apparatus 92 sends 
information used to specify that image to the 
authentication server 93 and requests the server 93 to 
25 send decryption key information. As a result since the 
authentication server 93 transmits the decryption key 
information, the apparatus 92 decrypts the encrypted 
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Image data using that key information, and then decodes 
(decompresses) the encoded image data. 
<Encoding (Compression) Processor) 

The encoding (compression) process in the 

5 encoding (compression) & encryption apparatus 91 , and 
an error-detecting encoding function executed during 
the former process will be explained first using Fig. 1. 

Referring to Fig. 1, reference numeral 11 denotes 
an image input unit; 12, a discrete wavelet 

10 transformer; 13, a quantizer; 14, an entropy encoding 
(compression) unit; and 15, a code output unit. The 
image input unit 11 receives pixel signals that form an 
image to be encoded (compressed) in the raster scan 
order, and its output is supplied to the discrete 

15 wavelet transformer 12. In the following description, 
an image signal represents a monochrome multi -valued 
image. However, when a plurality of color components 
of, e.g., a color image or the like are to be encoded 
(compressed), each of R, G, and B color components or 

20 each of luminance and chromaticity components may be 
encoded (compressed) as the monochrome component. 

The discrete wavelet transformer 12 executes a 
two-dimensional (2D) wavelet transformation process for 
the input image signal, and computes and outputs 

25 transformation coefficients. Fig. 2A shows the basic 

arrangement of the discrete wavelet transformer 12. An 
input image signal is stored in a memory 21, is 
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sequentially read out by a processor 22 to undergo the 
transformation process, and is written in the memory 21 
again. In this embodiment. Fig. 2B shows the 
arrangement of processes in the processor 22. 
5 Referring to Fig. 2B, an input image signal is 
separated into odd and even address signals by a 
combination of a delay element and down samplers. That 
is, the input pixel data are separated into even- and 
odd-numbered pixels. The separated pixel data undergo 
10 filter processes of two filters p and u. In Fig. 2B, s 
and d represent low- and high-pass coefficients upon 
decomposing a linear image signal to one level, and are 
respectively computed by: 

d(n) m x(2*n+l)-floor((x(2*n)+x(2*n+2))/2) (1) 
15 s(n) = x(2*n)+floor((d(n-l)+d(n))/4) (2) 

where x(n) is an image signal to be transformed. 

With the aforementioned process, a linear 
discrete wavelet transformation process is done for the 
image signal. Two-dimensional discrete wavelet 
20 transformation is implemented by sequentially executing 
linear transformation in the horizontal and vertical 
directions of an image. Since details of this process 
are known to those who are skilled in the art, a 
description thereof will be omitted. Fig. 2C shows a 
25 configuration example of transformation coefficient 
groups of two levels (meaning the number of times of 
wavelet transformation is "2") obtained by the 2D 
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transformation process. An Image signal is decomposed 
into different frequency bands HH1, HL1, LH1,..., and 
LL . Note that these frequency bands will be referred 
to as subbands hereinafter. The coefficients which 
5 respectively form the subbands are output to the 
quantizer 13. 

The quantizer 13 quantizes the input coefficients 
by a predetermined quantization step, and outputs 
indices corresponding to the quantized values . In this 
10 case, quantization is described by: 

q = sign(c) f loor (abs(c) /A) (3) 
sign(c) = 1; c ^ 0 (4) 
slgn(c) - -1; c < 0 (5) 
where c is a coefficient to be quantized. In this 
15 embodiment, the value A includes M l". When A = 1, no 
quantization is done in practice, and transformation 
coefficients input to the quantizer 13 are directly 
output to the entropy encoding unit 14. 

The entropy encoding unit 14 decomposes the input 
20 quantization Indices into bit planes, executes binary 
arithmetic encoding for respective bit planes, and 
outputs a code stream. Fig. 3 is a view for explaining 
the operation of the entropy encoding unit 14. In this 
example, a region in a subband having a 4 x 4 size 
25 Includes three nonzero quantization indices, which 
respectively have values n +13 M , n -6", and n +3 n . The 
entropy encoding unit 14 scans this region to obtain a 
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maximum value M, and computes the number S of bits 
required to express the maximum quantization index by: 
S = ceil(log2(abs(M))) (6) 
where ceil(x) is the smallest one of integers equal to 
5 or larger than x. 

In Fig. 3, since the maximum coefficient value is 
n 13" , S = 4. Hence, 16 quantization indices in the 
sequence are processed for respective four bit planes, 
as shown in Fig. 3. The entropy encoding unit 14 makes 
10 entropy encoding (binary arithmetic encoding in this 
embodiment) of bits of the most significant bit plane 
(indicated by MSB in Fig. 3) first, and outputs the 
encoding result as a bitstream. Then, the encoding 
unit 14 lowers the bit plane by one level, and encodes 
15 and outputs bits in each bit plane to the code output 
unit 15 until the bit plane of interest reaches the 
least significant bit plane (indicated by LSB in 
Fig. 3). In the entropy encoding, as for the sign of 
each quantization index, when a nonzero bit to be 
20 encoded first (most significantly) is detected upon 
scanning from the upper to lower bit planes, one bit 
indicating the sign of the quantization index of 
interest undergoes binary arithmetic encoding 
immediately after the nonzero bit. In this manner, the 
25 sign of a nonzero quantization index can be efficiently 
encoded . 
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Error- detecting encoding to be applied to this 
embodiment will be described below using Fig. 10. 
Referring to Fig. 10 , reference numeral 101 denotes a 
sequence of bits in one bit plane mentioned above. 
5 Reference numeral 102 denotes predetermined information 
to be appended after the sequence 101 for 
error-detecting encoding. This predetermined 
information will be referred to as a segmentation 
symbol hereinafter. Error-detecting encoding of this 
10 embodiment is implemented by entropy- encoding entire 

information formed by appending the segmentation symbol 
(102) after the original information (101) which is to 
be entropy- encoded , as shown in Fig. 10. Note that the 
encoding (compression) processor and a decoding 
15 (decompression) processor (to be described later) use 
the same value as the segmentation symbol. 

Figs. 4A to 4D show the configuration of the code 
stream which is generated and output in this way. 
Fig. 4A shows the overall configuration of the code 
20 stream, in which MH is a main header; TH, a tile 

header; and BS # a bit stream. As shown in Fig. 4B, main 
header MH is comprised of the size (the numbers of 
pixels in the horizontal and vertical directions) of an 
image to be encoded, the size of each tile upon 
25 breaking up the image into tiles as a plurality of 
rectangular regions, the number of components 
indicating the number of color components, the size of 
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each component, and component information indicating 
bit precision. In this embodiment, since the image is 
not segmented into tiles, the tile size and image size 
assume the same value, and the number of components is 
5 1 when an image to be encoded is a monochrome 
multi-valued image. 

Fig. 4C shows the configuration of tile header TH. 
Tile header TH consists of a tile length including the 
bitstream length and header length of the tile of 
10 interest, and an encoding parameter for the tile of 
interest. The encoding parameter includes a discrete 
wavelet transformation level, filter type, and the like. 
Furthermore, the encoding parameter includes 
information indicating whether or not error- detecting 
15 encoding is applied. This information (which can be 1 
bit) indicating whether or not error -detecting encoding 
is applied will be referred to as "first 
error-detecting encoding information" hereinafter. 
When the first error-detecting encoding information is 
20 "0", it indicates that no error-detecting encoding is 
applied; when the first error- detecting encoding 
information is "1", it indicates that error-detecting 
encoding is applied. 

Fig. 4D shows the configuration of the bitstream 
25 in this embodiment. In Fig. 4D, a bitstream is formed 
for respective subbands, which are arranged in turn 
from a subband having a low resolution in ascending 
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order of resolution. Furthermore , in each subband, 
codes are set for respective bit planes , i . e . , in the 
order from an upper bit plane to a lower bit plane. 

With the above code sequence, a code stream shown 
5 in Fig. 8A (to be described later) can be generated, 
and hierarchical decoding (decompression) shown in 
Fig. 8B can be made. 

In this embodiment, the compression ratio of the 
entire image to be encoded (compressed) can be 
10 controlled by changing the quantization step A. 

As another method, in this embodiment, the lower 
bits of a bit plane to be encoded by the entropy 
encoding unit 14 may be limited (discarded) in 
correspondence with a required compression ratio. In 
15 such case, not all bit planes are encoded, but bit 
planes from the most significant bit plane to a bit 
plane corresponding in number to the required 
compression ratio are encoded, and are contained in a 
final code stream. 
20 <Decoding (Decompression) Processor > 

A method of decoding (decompressing) a code 
stream generated by the aforementioned encoding 
(compression) processor, and error -detecting function 
will be described below. Fig. 5 is a block diagram 
25 showing the arrangement of the decoding (decompression) 
processor. In Fig. 5, reference numeral 51 denotes a 
code input unit; 52, an entropy decoding 
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(decompression) unit; 53 , a dequantizer; 54, an inverse 
discrete wavelet transformer; and 55, an image output 
unit. 

The code input unit 51 receives a code stream, 
5 analyzes the header included in that code stream to 
extract parameters required for the subsequent 
processes, and controls the flow of processes if 
necessary or outputs required parameters to the 
subsequent processing units. The bitstream included in 

10 the code stream is output to the entropy decoding 
(decompression) unit 52. 

The entropy decoding (decompression) unit 52 
decodes (decompresses) and outputs the bitstream for 
respective bit planes. The decoding sequence at that 

15 time is as shown in Pig. 6. Fig. 6 shows the flow of 

the process for sequentially decoding (decompressing) a 
given region of a subband to be decoded (decompressed) 
for respective bit planes (in case of four planes), and 
finally restoring quantization indices. The bit planes 

20 are decoded (decompressed) in the order of an arrow in 
Fig. 6. The restored quantization indices are output 
to the dequantizer 53. 

The error-detecting function of this embodiment 
will be described below. Whether or not data has been 

25 error- detecting encoded can be determined by analyzing 
the header contained in the input code stream, and 
checking first error- detecting encoding information 
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contained in the encoding parameter in the header. 
When the first error-detecting encoding information is 
"1" (it is determined that the code stream has been 
error- detecting encoded) , whether or not the appended 
5 segmentation symbol (102 in Fig. 10) of the 

entropy- decoded (decompressed) bit planes matches that 
appended by the aforementioned encoding processor is 
checked. When these segmentation symbols match , it is 
determined that no error has occurred; otherwise, it is 

10 determined that an error has occurred. If an error has 
occurred, the code stream can be normally decoded 
(decompressed) by transmitting a re- send request of the 
corresponding bit plane to the transmitting side. 

The dequantizer 53 reclaims discrete wavelet 

15 transformation coefficients from the input quantization 
indices by: 

c 1 = A*q; q * 0 (7) 
C 1 = 0; q = 0 (8) 
where q is the quantization index, A is the 
20 quantization step, which is the same value used upon 
encoding, and c 1 is the restored transformation 
coefficient, which is obtained by restoring a 
coefficient s or d in encoding. The transformation 
coefficient c 1 is output to the inverse discrete 
25 wavelet transformer 54. 

Figs. 7A and 7B are block diagrams showing the 
arrangement and processes of the inverse discrete 
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wavelet transformer 54. In Fig. 7A, the input 
transformation coefficients are stored in a memory 71. 
A processor 72 executes linear inverse discrete wavelet 
transformation, and implements 2D inverse discrete 
5 wavelet transformation by sequentially reading out the 
transformation coefficients from the memory 71. The 2D 
inverse discrete wavelet transf ormation is executed in 
a sequence opposite to the forward transformation, but 
since its details axe known to those who are skilled in 
10 the art, a description thereof will be omitted. 

Fig. 7B shows, processing blocks of the processor 72. 
. The input transformation coefficients undergo two 
filter processes of filters u and p. The processed 
transformation coefficients are added after up- sampling, 
15 thus outputting an image signal x 1 . These processes 
are described by: 

x 1 (2*n)=s 1 (n) -floor ( (d' (n-U+d 1 (n) )/4) (9) 
x 1 (2*n+l)=d f (n)+floor((x' (2*n)+x f (2*n+2))/2) (10) 
Note that the forward and inverse discrete 
20 wavelet transformation processes given by equations (1), 
(2), (9), and (10) satisfy a perfect reconstruction 
condition. Hence, since the quantization step A = 1 in 
this embodiment, the restored image signal x' matches 
an original image signal x if all bit planes are 
25 decoded (decompressed) in bit plane decoding 
(decompression) . 
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With the aforementioned process, an image signal 
is reclaimed and is output to the image output unit 55. 
The image output unit 55 may be an image display device 
such as a monitor or the like, or may be a storage 
5 device such as a magnetic disk or the like. 

The image display pattern upon restoring and 
displaying an image in the aforementioned sequence will 
be explained using Figs. 8A and 8B. Fig. 8A shows an 
example of a code stream, the basic configuration of 

10 which is based on Figs. 4A to 4D, but the entire image 
is set as a tile. Therefore, the code stream contains 
only one tile header and bitstream. In bitstream BS, 
codes are set in turn from LL as a subband 
corresponding to the lowest resolution in ascending 

15 order of resolution, as shown in Fig. 8A. 

The decoding (decompression) processor 
sequentially reads this bitstream, and displays an 
image upon completion of decoding (decompression) of 
codes corresponding to each subband. Fig. 8B shows 

20 correspondence between respective subbands, and the 

sizes of images to be displayed. In this example, two 
levels of 2D discrete wavelet transformation processes 
are done, and when LL alone is decoded (decompressed) 
and displayed, an image, the numbers of pixels of which 

25 are reduced to 1/4 in the horizontal and vertical 
directions with respect to the original image, is 
restored. When bit streams are further read and all 
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subbands of level 2 are decoded (decompressed) and 
displayed, an image , the numbers of pixels of which are 
reduced to 1/2 in the horizontal and vertical 
directions, is restored. Also, when all subbands of 
5 level 1 sure decoded (decompressed) , an image having the 
same number of pixels as that of the original image is 
restored. 

In the aforementioned embodiment , when the 
entropy decoding (decompression) unit 52 limits 

10 (ignores) lower bit planes to be decoded (decompressed), 
the encoded data size to be received or processed is 
reduced, and the compression ratio can be consequently 
controlled. In this manner, a decoded image with 
required image quality can be obtained from only 

15 encoded data of the required data size. When the 

quantization step A upon encoding is "l n , and all bit 
planes are decoded (decompressed) upon decoding 
(decompression), lossless encoding/ decoding that allows 
a decoded image to match with an original image can be 

20 implemented . 

<Encryption Processor) 

An encryption processor that can be applied to 
this embodiment will be described below using Fig. 11. 



25 denotes a code input unit; 112, an encryption 

processing unit; and 113, a code output unit. In 
Pig. 11, assume, for the sake of easy understanding. 



Referring to Fig. 11, reference numeral 111 
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that the code Input unit 111 receives the output result 
of the code output unit 15 in Fig. 1. 

The code input unit 111 receives a code stream , 
analyzes the header included in that code stream to 
5 extract parameters required for the subsequent 

processes, and outputs required parameters to the 
subsequent processing units. The bitstream contained 
in the code stream is output to the encryption 
processing unit 112. 

10 The encryption processing unit 112 receives the 

bitstream, encrypts the bitstream in accordance with 
information (stored in, e.g., a hard disk), which is 
designated by the operator or set in advance, and 
outputs the encrypted bitstream. 

15 The encryption process executed by the encryption 

processing unit 112 will be described below using 
Fig. 12. Fig. 12 is a flow chart showing the 
encryption process that can be applied to this 
embodiment . 

20 It is checked in step S121 if the input bitstream 

has been error-detecting encoded. This checking 
process can be attained using the first error-detecting 
encoding information contained in the encoding 
parameter, which is analyzed by the code input unit 111. 

25 If the first error-detecting encoding information is 
"1" (it is determined that the bitstream has been 
error- detecting encoded) , the flow advances to step 
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S122; If the first error-detecting encoding information 
is "0" (it is determined that the bit stream has not 
been error- detecting encoded) , the flow jumps to step 
S124. 

5 In step S122, the first error-detecting encoding 

information is changed to "0". That is, the first 
error- detecting encoding information is changed to 
indicate that "no error- detecting encoding is applied" . 
This is to prevent the error- detecting function of the 
10 decoding (decompression) processor from erroneously 
determining that "an error has occurred" in the 
encryption process in step S124 (to be described later). 
Since the first error -detecting encoding information is 
set to be "0", the error-detecting function of the 
15 decoding (decompression) processor is disabled, but 
erroneously determining that "an error has occurred" 
can be prevented. After step S122, the flow advances 
to step S123. 

In step S123, second error- detecting encoding 
20 information, which is different from the first 

error -detecting encoding information, is set to be "1". 
The second error-detecting encoding information 
indicates "whether or not the bitstream before 
encryption has been error-detecting encoded. If the 
25 second error-detecting encoding information is "1", it 
indicates that the bitstream before encryption has been 
error-detecting encoded; if the second error- detecting 
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encoding information is "0 n , it indicates that the 
bitstream before encryption has not been 
error -detecting encoded. The second error-detecting 
encoding information is used in a decryption processor 
5 (to be described later) to compensate for the first 
error-detecting encoding information that has been 
changed in step S122. That is, a process equivalent to 
that for saving the original error- detecting encoding 
information is executed. 

10 The second error-detecting encoding information 

can be recorded in a header or as a comment contained 
in the header. Alternatively, the second 
error -detecting encoding information may be appended to 
a predetermined position of a bitstream f and may be 

15 encrypted together with the bitstream in the next 
encryption process so as to be contained in the 
encrypted text. 

In step S124, the encryption process is applied 
to the input bitstream. As the encryption process, all 

20 data contained in the input bitstream may be encrypted, 
or some of them may be partially encrypted. By 
partially encrypting the bitstream, access control that 
allows everybody to browse non- encrypted data, and only 
an authentic user to also browse encrypted data can be 

25 made. 

In the present invention, an object to be 
encrypted is not particularly limited, and various data 
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such as the aforementioned predetermined subbands, bit 
planes , tiles , and the like may be set as an object to 
be encrypted. In the present invention, the encryption 
process is not particularly limited, and various 
5 encryption schemes such as DES, AES, RSA, and the like 
can be applied. 

In this embodiment, step S124 is processed after 
steps S121, S122, and S123. Alternatively, steps S121, 
S122, and S123 may be processed after step S124. 

10 The header information and encrypted bits t ream 

generated by the aforementioned process are output to 
the next code output unit 113. 

The code output unit 113 receives the header 
information and encrypted bitstream generated by the 

15 encryption processing unit 112, and outputs them as an 
encrypted code stream. 

As described above, according to this embodiment, 
when encoded image data is input and is encrypted, even 
when error- detecting encoding information is appended 

20 to that encoded image data, the decoding 

(decompressing) /decrypting side (e.g., a PC) can be 
avoided from erroneously recognizing that image data 
has an error, by removing the error- detecting encoding 
information. 

25 Note that the apparatus on the decoding 

(decompressing) /decrypting side that receives encoded 
data which has been encrypted on the encrypting side 
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cannot decompress the encoded data to normal image data 
(e.g., bitmap data) unless it decrypts the encrypted 
data. In other words, the apparatus on the decoding 
(decompressing) /decrypting side must acquire decryption 
5 key information using some means. In the simplest way, 
the decoding (decompressing) /decrypting side may 
request the encrypting side to send a decryption key. 
For example, when both these apparatuses are connected 
to a network such as the Internet or the like, an 

10 authentication server that manages information required 
to specify each image data and decryption key 
information may be located, and upon reception of the 
information required to specify the image data, 
corresponding decryption key information may be 

15 transmitted to the request source. 

The operation in the encryption process of this 
embodiment has been explained. As can be easily 
analogized from the above description, the encryption 
processor of this embodiment can be implemented by an 

20 information processing apparatus such as a personal 

computer or the like. Since the above functions need 
only be implemented by the information processing 
apparatus such as a personal computer or the like, a 
characteristic feature of this embodiment covers an 

25 information processing method, a computer program, and 
a computer readable storage medium such as a CD-ROM 
that stores the computer program. 
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<Decryption Processor) 

A decryption processor that can be applied to 
this embodiment will be described below using Fig. 13. 
Referring to Fig. 13 , reference numeral 131 
5 denotes a code input unit; 132, a decryption processing 
unit; and 133, a code output unit. Assume, for the 
sake of easy understanding, that the code input unit 51 
in the decoding (decompression) apparatus shown in 
Fig. 5 receives code data output from the code output 
10 unit 133. 

The code input unit 131 receives a code stream, 
analyzes the header included in that code stream to 
extract parameters required for the subsequent 
processes, and outputs required parameters to the 
15 subsequent processing units. The bitstream contained 
in the code stream is output to the decryption 
processing unit 132. 

The decryption processing unit 132 receives the 
bitstream, decrypts the bitstream, and outputs a 
20 decrypted bitstream. 

The decryption process executed by the decryption 
processing unit 132 will be described below using 
Fig. 14. Fig. 14 is a flow chart showing the 
decryption process that can be applied to this 
2 5 embodiment . 

It is checked in step S141 if the input bitstream 
has been error -detecting encoded before encryption. 
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This checking process can be attained using the second 
error-detecting encoding information contained in the 
header or the like, which is analyzed by the code input 
unit 111. If the second error- detecting encoding 
5 information is "0" (it is determined that the bit stream 
has not been error -detecting encoded) , the flow 
advances to step S143 to check if decryption key 
information is available. If it is determined that no 
decryption key information is available, this process 

10 ends, and encoded data is directly output to a 

low-order process. If it is determined that decryption 
key information is available, a process for decrypting 
the encrypted data (decryption process), and decrypted 
data is output to a low-order process. 

15 On the other hand, if it is determined in step 

5141 that the input bitstream has been error-detecting 
encoded before encryption, the flow advances to step 

5142 to check if decryption key information is 
available. If no decryption key information is 

20 available, this process ends. That is, the same 

process as that upon determining NO in step S143 is 
made . 

On the other hand, if it is determined that 
decryption key information is available, the flow 
25 advances to step S144 to change the first 

error-detecting encoding information from "0" to "1". 
That is, the first error-detecting encoding information 
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is changed to indicate that "error -detecting encoding 
is applied". This process enables the error -detecting 
function again in the decoding (decompression) 
processor by changing the first error-detecting 
5 encoding information to n l n . 

In step S145, a decryption process is applied to 
the input bitstream on the basis of the decryption key 
information. The decryption process must correspond to 
the encryption process in step S124 described above. 
10 The header information and decrypted bitstream 

generated by the above process are output to the code 
output unit 133. 

In this embodiment , the decryption process is 
executed after the first error-detecting encoding 
15 information is changed. However, the present invention 
is not limited to such specific process. For example, 
the first error- detecting encoding information may be 
changed after the decryption information is executed, 
as shown in Fig. 15. 
20 Especially, when the second error- detecting 

encoding information is contained in the encrypted text 
in the encryption processor, the decryption process 
must be executed according to the flow shown in Fig. 15. 
Since the second error- detecting encoding information 
25 is contained in the encrypted text, it is difficult to 
normally check the second error- detecting encoding 
information in the encrypted state. 
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The code output unit 133 receives the header 
information and decrypted bitstream generated by the 
decryption processing unit 132, and outputs them as a 
decrypted code stream. Note that the decryption 
5 processor may be connected to the aforementioned 
decoding (decompression) processor to successively 
execute the decoding (decompression) process. 

As described above, according to this embodiment, 
an encrypted code stream can be prevented from being 
10 erroneously determined that it has an error, as a 
result of the encryption process. 

More specifically, even when the encrypting 
apparatus appends an error-detecting code, it is 
apparently determined that no error- detecting encoded 
15 data is present (in practice, error-detecting encoded 
data is present but is ignored) upon executing the 
encryption process. Therefore, the decoding 
(decompressing) /decrypting apparatus can be prevented 
from erroneously determining that data has an error, 
20 and transmitting a re-send request, as long as data is 
normally transmitted. 

When the decoding (decompressing) /decrypting 
apparatus has acquired decryption key information used 
to decrypt an encryption key, encrypted data is 
25 decrypted, and the error- detecting code is available. 
Hence, even when noise is mixed during data 
transmission, a re-send request can be issued to 
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reclaim a normal Image. The operation in the 
decryption processor in this embodiment has been 
explained. 

As can be easily analogized from the above 
5 description , the decryption processor of this 
embodiment can be implemented by an information 
processing apparatus such as a personal computer or the 
like. Since the above functions need only be 
implemented by the information processing apparatus 

10 such as a personal computer or the like, a 

characteristic feature of this embodiment covers an 
information processing method, a computer program, and 
a computer readable storage medium such as a CD-ROM 
that stores the computer program. 

15 [Second Embodiment] 

The above embodiment (first embodiment) requires 
the second error-detecting encoding information 
indicating whether or not data has been error-detecting 
encoded before encryption. However, the present 

20 invention is not limited to such specific embodiment, 
and the need for the second error-detecting encoding 
information may be obviated. Hence, the second 
embodiment will explain a method that does not require 
any second error -detecting encoding information. 

25 <Encryption Processor) 

An encryption processor of this embodiment will 
be described first using Fig. 16. 



WO 2004/066552 P£X/JP2004/000619 

- 29 - 



Referring to Pig. 16 , reference numeral 161 
denotes a code input unit; 162, an entropy decoding 
(decompression) unit; 163, an encryption processing 
unit; 164, an entropy encoding unit; and 165, a code 
5 output unit. 

Since the processes executed by the code input 
unit 161, entropy decoding (decompression) unit 162, 
entropy encoding unit 164, and code output unit 165 are 
equal to those executed by the code input unit 51, 
10 entropy decoding (decompression) unit 52, entropy 

encoding unit 14, and code output unit 15 in the first 
embodiment, a detailed description thereof will be 
omitted. Hence, details of the encryption process in 
the encryption processing unit 163 which executes a 
15 different process in the second embodiment will be 
described below. 

Fig. 17 is a flow chart showing the encryption 
process that can be applied to this embodiment. 

In step S171, the aforementioned entropy decoding 
20 (decompression) process is applied for respective bit 
planes using the entropy decoding (decompression) unit 
162. In step S172, an encryption process is executed 
for the entropy -decoded (decompressed) data. 

It is checked in step SI 73 if the input bit stream 
25 has been error-detecting encoded. This checking 

process can be attained using the first error -detecting 
encoding information contained in the encoding 
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parameter, which is analyzed by the code input unit 161. 
If the first error- detecting encoding information is 
n l n (it is determined that the bit stream has been 
error- detecting encoded) , the flow advances to step 
5 S174; if the first error-detecting encoding information 
is n 0 w (it is determined that the bit stream has not 
been error -detecting encoded) , the flow Jumps to step 
S175. 

In step S174, a segmentation symbol is appended 
10 after the data encrypted in step S172. In this way, 
the error-detecting function can be given to the 
encrypted data. 

In step S175, the entropy encoding process is 
applied to the encrypted data for respective bit planes 
15 using the entropy encoding unit 164. If the 

segmentation symbol is appended in step S174, the 
entropy encoding process is applied together with the 
segmentation symbol. 

The header information and encrypted bitstream 
20 generated by the aforementioned process are output to 
the next code output unit 165. 
<Decryption Processor) 

The process on the side of decoding 
(decompressing) image data in this embodiment will be 
25 described below. 

Fig. 18 is a block diagram of a decryption 
processor that can be applied to the second embodiment. 
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Referring to Pig. 18, reference numeral 181 denotes a 
code input unit; 182 , an entropy decoding 
(decompression) unit; 182, a decryption unit; 184, an 
entropy encoding unit; and 185, a code output unit. 
5 Assume, for the sake of easy understanding, that the 
code input unit 51 in Fig. 5 receives the code output 
unit 185. 

Unlike in the first embodiment (Fig. 13), the 
decryption unit 183, and the entropy decoding 

10 (decompression) unit 182 and entropy encoding unit 184, 
which are respectively connected to the input and ' 
output sides of the unit 183, are provided. Since the 
entropy decoding (decompression) unit 182 and entropy 
encoding unit 184 execute the same processes as those 

15 in the encryption apparatus, details of the decryption 
process in the decryption unit 183 will be described 
below using Fig. 19. 

It is checked in step S191 if decryption key 
information is available. If NO in step S191, this 

20 process ends. 

If decryption key information is available, the 
flow advances to step S192 to execute the 
aforementioned entropy decoding (decompression) process 
using the entropy decoding (decompression) unit 182. 

25 Subsequently, the decryption process is executed for 
the entropy- decoded (decompressed) data in step S193. 
The decryption process to be executed in step S193 must 
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correspond to step S172 mentioned above. In step S194, 
the aforementioned entropy encoding process is executed 
for respective bit planes using the entropy encoding 
unit 184. 

5 The header information and decrypted bitstream 

generated by the aforementioned process are output to 
the code output unit 185 , which passes them to the 
process shown in Fig. 5. 

By executing the aforementioned encryption 

10 process, the error- detecting encoding function can be 
given to the encrypted data. 

The operations in the encryption processor and 
decryption processor in this embodiment have been 
explained. As can be easily analogized from the above 

15 description, the encryption and decryption processors 

of this embodiment can be implemented by an information 
processing apparatus such as a personal computer or the 
like. Since the above functions need only be 
implemented by the information processing apparatus 

20 such as a personal computer or the like, a 

characteristic feature of this embodiment covers an 
Information processing method, a computer program, and 
a computer readable storage medium such as a CD-ROM 
that stores the computer program. 

25 [Third Embodiment] 

The second embodiment has exemplified a case 
wherein the error- detecting encoding process is 
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executed in entropy encoding (the entropy encoding unit 
14 in Fig. 1) on the assumption of JPEG2000 or the like. 
However, the present invention is not limited to such 
specific embodiment. That is, an error-detecting code 
5 may be independently appended upon encryption. Such 

example will be described below as the third embodiment. 
<Encryption Processor) 

An encryption processor (encryption apparatus) of 
this embodiment will be described below using Fig. 20. 
10 Referring to Fig. 20, reference numeral 201 

denotes a code input unit; 202, an encryption 
processing unit; 203, an error- detecting encoding unit; 
and 204, a code output unit. Assume, for the sake of 
easy understanding, that the encoding unit 201 receives 
15 the output result of the code output unit 15 in Fig. 1. 
In this embodiment, however, encoded data to be input 
to the code input unit 201 is not limited to such 
specific data, but data generated by other encoding 
(compression) processes may be input. 
20 Fig. 21 is a flow chart showing an encryption 

process and error -detecting encoding process that can 
be applied to this embodiment. 

In step S211, an encryption process is executed 
for the input bitstream using the encryption processing 
25 unit 202. Note that the input bitstream contains 

encoded image data, which is either appended or not 
appended with an error-detecting code. If input 
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encoded data is "encoded image data + error-detecting 
code" , the encryption process in this step encrypts 
together with the error-detecting code. If no 
error- detecting code is appended, an object to be 

5 encrypted is "encoded image data" alone, as a matter of 
course. Hence, if input encoded data is "encoded image 
data + error- detecting code", one stream which has no 
distinction between them is generated after encryption. 
The flow advances to step S212 to check if the 

10 encrypted encoded data includes the error- detecting 

code. This checking process can be coped with by, e.g., 
referring to first -detecting encoding information 
described in the first and second embodiments. Also, 
in some cases, whether or not an error-detecting code 

15 can be detected may be determined in practice. 

The reason why the "error-detecting code" is used 
is to improve the reliability of encoded image data. 
Hence, if YES in step S212, error-detecting encoding is 
made in step S213 to improve the reliability of 

20 transmission of the encrypted data. On the other hand, 
if NO in step S212, since no error -detecting encoding 
is made, the process in step S213 is skipped. 

With the aforementioned encryption process, the 
error- detecting encoding function can be given to 

25 encrypted data. 

The operations in the encryption processor and 
decryption processor in this embodiment have been 
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explained • As can be easily seen from the above 
description , the encryption and decryption processors 
of this embodiment can be implemented by an information 
processing apparatus such as a personal computer or the 
5 like. Since the above functions need only be 

implemented by the information processing apparatus 
such as a personal computer or the like, a 
characteristic feature of this embodiment covers an 
information processing method, a computer program, and 

10 a computer readable storage medium such as a CD-ROM 
that stores the computer program. 

As described above, according to the present 
invention, even when encoded (compressed) image data 
appended with an error-detecting code is encrypted, the 

15 apparatus which receives and reproduces that image data 
can execute a normal process without any insignificant 
re-send request and the like. 

As many apparently widely different embodiments 
of the present invention can be made without departing 

20 from the spirit and scope thereof, it is to be 

understood that the invention is not limited to the 
specific embodiments thereof except as defined in the 
claims . 
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CLAIMS 



1. An information processing method for encrypting 
encoded image data, comprising: 

5 a step of inputting encoded image data; 

a step of encrypting the input encoded image 
data; and 

a step of changing presence/absence information, 
which is contained in header data of the encoded image 
10 data indicates presence/absence of an error -detecting 
code, to the absence of the error-detecting code, and 
outputting the encrypted encoded image data. 

2. The method according to claim 1, further 
comprising a step of outputting decryption key 

15 information required to decrypt encrypted data. 

3. The method according to claim 1, further 
comprising a step of saving the presence/absence 
information in the input encoded image data at another 
location in the header data. 

20 4. The method according to claim 3, wherein the 
saving step includes a step of saving the 
presence/absence information in the header data as a 
comment . 

5. An information processing method for decrypting 
25 image data encrypted by em information processing 
method of claim 3, comprising: 

a step of inputting encoded image data; 
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a first checking step of checking whether or not 
the saved presence/absence information indicates the 
presence of the error -detecting code; 

a second checking step of checking whether or not 
5 key information required to decrypt encrypted data is 
available; and 

a step of changing , when it is determined in the 
first and second checking steps that the 
error-detecting code is present and the decryption key 

10 information is available, the presence/absence 
information contained in the header data to the 
presence of the error- detecting code, decrypting the 
encrypted data, and passing the decrypted data to an 
encoded image data decoding process . 

15 6. The method according to claim 5, wherein when it 
is determined in the first and second checking steps 
that the error- detecting code is absent and the 
decryption key information is available, the encrypted 
data is decrypted without changing the presence/absence 

20 information in the header data. 

7. The method according to claim 5, wherein when it 
is determined in the first and second checking steps 
that the decryption key information is not available, 
the input encoded image data is directly passed to the 

25 encoded image data decoding process. 

8. An information processing apparatus for 
encrypting encoded image data, comprising: 
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a unit for inputting encoded image data; 
a unit for encrypting the input encoded image 
data; and 

a unit for changing presence/absence information, 
5 which is contained in header data of the encoded image 
data and indicates presence/absence of an 
error- detecting code, to the absence of the 
error -detecting code, and outputting the encrypted 
encoded image data. 
10 9. A computer program which functions as an 

information processing apparatus for encrypting encoded 
image data, when said program is loaded and executed by 
a computer, said program functioning as: 

a unit for inputting encoded image data; 
15 a unit for encrypting the input encoded image 

data; and 

a unit for changing presence/absence information 
indicating presence/absence of an error-detecting code 
contained in header data of encoded data to the absence 
20 of the error -detecting code, and outputting the 
encrypted encoded image data* 

10. A computer readable storage medium storing a 
computer program of claim 9* 

11. An information processing method for encrypting 
25 encoded image data, comprising: 

a step of inputting encoded image data; 
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a step of decoding and encrypting the input 
encoded image data; 

a step of checking presence /absence information 
which is contained in header data of the input encoded 
5 image data and indicates presence/absence of an 
error-detecting code; and 

a re -encoding control step of re -encoding, when 
it is determined in the checking step that the 
error-detecting code is absent, the encrypted image 
10 data, and appending, when it is determined in the 

checking step that the error- detecting code is present, 
a segmentation symbol indicating the presence of the 
error- detecting code to the image data encrypted in the 
encryption step, and re-encoding the encrypted image 
15 data appended with the segmentation symbol. 

12. The method according to claim 11, wherein the 
decoding step includes a step of performing entropy 
decoding, and the re-encoding control step includes a 
step of performing entropy encoding. 
20 13. An information processing method for decrypting 
image data encrypted and encoded by an information 
processing method of claim 11, comprising: 

a step of inputting encrypted encoded image data; 
a step of decoding the encoded image data input 
25 in the input step; 

an encoding step of decrypting the encrypted 
image data on the basis of key information required to . 
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decrypt encrypted data, and re -encoding the decrypted 
data; and 

a step of output ting the re -encoded data to a 
low-order encoded image data decoding process* 
5 14. An information processing method for encrypting 
encoded image data, comprising: 

a unit for inputting encoded image data; 
a unit for decoding and encrypting the input 
encoded image data; 
10 a unit for checking presence/absence information 

which is contained in header data of the input encoded 
image data and indicates presence/absence of an 
error-detecting code; and 

a re-encoding control unit for, when said 
15 checking unit determines that the error- detecting code 
is absent, re-encoding the encrypted image data, and 
for, when said checking unit determines that the 
error-detecting code is present, appending a 
segmentation symbol indicating the presence of the 
20 error -detecting code to the image data encrypted by 
said encryption unit, and re-encoding the encrypted 
image data appended with the segmentation symbol. 
15. A computer program which functions as an 
information processing apparatus for encrypting encoded 
25 image data, when said program is loaded and executed by 
a computer, said program functioning as: 

a unit for inputting encoded image data; 
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a unit for decoding and encrypting the input 
encoded image data; 

a unit for checking presence/absence information 
which is contained in header data of the input encoded 
5 image data and indicates presence/ absence of an 
error- detecting code; and 

a re -encoding control unit for, when said 
checking unit determines that the error-detecting code 
is absent , re-encoding the encrypted image data, and 
10 for, when said checking unit determines that the 
error- detecting code is present, appending a 
segmentation symbol indicating the presence of the 
error-detecting code to the image data encrypted by 
said encryption unit, and re-encoding the encrypted 
15 image data appended with the segmentation symbol. 
16. A computer readable storage medium storing a 
computer program of claim 15. 
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